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In order to apply thermodynamics to systems in which entropy is not extensive, it has become customary to define 
generalized entropies. While this approach has been effective, it is not the only possible approach. We suggest that 
some systems, including nanosystems, can be investigated by instead generalizing the concept of extensivity. We begin 
by reexamining the role of linearity in the definition of complex physical systems. We show that there is a generalized 
form of extensivity that can be defined for a number of non- linear systems. We further show that a generalization of the 
principle of linear superposition is the basis for defining generalized extensivity. We introduce a definition for the the 
degree of non-extensivity for systems. We show that generalized extensivity can be used as a means of understanding 
complex physical systems and we propose extending the idea extensivity beyond thermodynamics to other physical 
systems, including nanosystems. 
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1. Introduction 

A number of authors have proposed generalizations of 
entropy to address the problem of providing a universal 
measure of complexity or disorder, examples include Tsal- 
lis entropy, and Renyi entropy One of the proper- 
ties of entropy that remains controversial is the issue of 
extensivity-the appearance of linear or additive behavior 
of the subcomponents of a system when taken as a whole. 
Extensivity is not a universal feature of entropy, though 
it is often treated as if it is @, However, a variety of 
sources have demonstrated that entropic extensivity can- 
not be one of the fundamental axioms of thermodynamics, 
see Q for further discussions. 

To illustrate that extensivity is not a fundamental ax- 
iom of thermodynamics, we may consider a familiar exam- 
ple: entropy was defined phenomenologically by Clausius 
as an integral over a reversible path, but as Jaynes [5| ob- 
served the Clausius definition says nothing about exten- 
sivity, since the size of the system does not vary over the 
integration path. Furthermore, Hill, in pioneering work 
in the 1960s noted that extensivity does not apply to all 
entropic systems, particularly those which exist at small 
scales [6j-|8[- Thus, extensivity is a notion independent of 
entropy. The subject of this paper is how to generalize 
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extensivity so it applies to more general complex systems. 
There is an advantage in attempting to generalize what 
can be thought of as a purely mathematical concept. Ex- 
tensivity can be generalized in a straightforward manner 
without bringing along the physical ideas associated with 
entropy; in this way we can avoid the confusion that often 
arises from mixing the physical and mathematical aspects 
of entropy. 

In complex, compound systems, the meaning of exten- 
sivity needs to be explored in order to gain insight into the 
meaning of complexity. Instead of proposing yet another 
generalization of entropy, we will show that the notion of 
extensivity can be generalized. Generalized extensivity al- 
lows us to replace the classical notion of extensivity by 
considering a more general notion of superposition. By 
choosing to broaden the notion of what constitutes an ex- 
tensive system rather than changing the notion of what 
classical entropy means, we choose to economize the phys- 
ical interpretation of entropy; this serves an economy of 
purpose consistent with Occam's razor. 

We take a contrarian viewpoint to the proposed gen- 
eralization of entropy by Tsallis 0| as well as many sub- 
sequent ideas that are summarized in [ltj. This approach 
allows us to suggest an approach to addressing the follow- 
ing the point made by Boon and Tsallis fill ] : 

Asking whether the entropy of a system is or 
is not extensive without indicating the composi- 
tion law of its elements, is like asking whether 
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some body is or is not in movement without 
indicating the referential with regard to which 
we are observing the velocity. 

The formalism of generalized superposition can be used to 
ask what type of functions allow a nonlinear combination 
to give the appearance of superposition. 

We suggest several different forms of generalized exten- 
sivity can be defined, including one associated with power 
laws which is connected to Tsallis entropy. As part of 
this exploration, we cast Tsallis entropy in a manner that 
is consistent within the framework of generalized exten- 
sivity. Thus, instead of being concerned whether Tsallis 
entropy has the appearance of extensivity or when it is in- 
herently non-extensive, we propose that it can be viewed 
as having the property of extensivity in the same context 
that a law of generalized superposition can be found, e.g. 
when it can be related to power laws. We also discuss the 
role generalized superposition plays in the understanding 
of power laws. 



we have the appearance of superposition. For example, 
the Boltzmann definition of entropy is S = k In f2, so under 
the circumstances that the microstates are multiplicative 
O = O1O2, then the entropy of the combined states is S = 
Si + S 2 ; so the Boltzmann entropy obeys the principle of 
generalized extensivity. We then introduce the definition 

S = log[x(n)], (5) 

so that Eq. (4) becomes 

S = Si + S 2 . (6) 

This is an example of a non-linear combination of compo- 
nents that can be re-interpreted as obeying superposition 
principle. This suggests that we can look for an underly- 
ing generalized superposition principle, that is extensivity, 
in many complex systems. Such a principle exists in sig- 
nal processing, in the analysis of homomorphic systems, 
that has wider applications in complex systems as we now 
discuss. 



2. The Principle of Superposition and Generalized 
Extensivity 

The notion of extensivity can be developed mathemat- 
ically by relating it to the theory of linear systems. For 
a linear system with inputs Xj(n), scalars Cj and a system 
transform T () there is always a rule for combining inputs 
to give outputs. This system will be linear, provided the 
system obeys the principle of superposition (where+ de- 
notes ordinary addition) 

T[xi(n)+x 2 {n)]=T[xi{n)}+T[x 2 {n)} (1) 

and scalar multiplication • 

T[c- x(n)] = cT[x(n)} (2) 

There are many physical quantities where combinations 
behave like linear systems and obey the principle of super- 
position. Mass and energy are examples of quantities that 
exhibit this property, when individual components of mass 
and energy are combined, the result is the combination of 
the individual masses and energies. Thus both mass and 
energy are extensive variables. On the other hand, tem- 
perature is not extensive because it is not additive over 
sub-systems. 

The most familiar example of a combination of compo- 
nents that is not extensive is multiplication. For a system 
with a law of combination defined by multiplication: 



x{n) = [xi{n)\ ■ [x 2 (n)j 



(3) 



with the introduction of a separator function for multipli- 
cation, the logarithm, 



logx(n) = log([£Ei(n)] • [x 2 (n)]) 

= log [a;i(n)] -flog [x 2 {n)} 



(4) 



2.1. Generalized Extensivity 

In order to generalize the idea of superposition in linear 
systems to non-linear systems, Oppenheim [12| proposed a 
modification of Eq. (1) and Eq. (2). The summation sign 
in Eq. (I) must be replaced with two different symbols: a 
rule for combining inputs designated by ©, and a rule for 
combining outputs designated by ffi. We then write the 
generalized superposition principle for such a system with 
a system transform H () as 

H [xi(n) © x 2 (n)} = H [x^n)] © H [x 2 (n)} (7) 

which is the generalization of Eq. (1) for nonlinear sys- 
tems. A similar replacement is required for scalar multi- 
plication by a constant c, so the generalization of Eq. (2) 
is 

H [c ® x(n)] = c o H [x{n)} (8) 

where © replaces the input scalar multiplication and o 
replaces the output scalar multiplication. The notation 
we have adopted is and adaptation of the notation used in 
the signal processing literature 

Systems with inputs and outputs that satisfy both (7) 
and (8) are called homomorphic systems since they can be 
represented as algebraically linear (homomorphic) map- 
pings between the input and output signal spaces. Op- 
penheim and Schafer have written a brief history of signal 
processing background for solving certain non-linear signal 
processing problems which are the origin of their classifi- 
cation scheme 14] . They summarized this informally, by 



stating that all homomorphic systems can be thought of 
in the following manner: 

• ■ ■ all homomorphic systems have canon- 
ical representation consisting of a cascade of 
three systems. The first system is an invert- 
ible nonlinear characteristic operator (system) 
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that maps a nonadditive combination opera- 
tion such as a convolution into ordinary ad- 
dition. The second system is a linear system 
obeying additive superposition, and the third 
system is the inverse of the first nonlinear sys- 
tem. 

The logarithmic function is a separator function for 
multiplication. That is why there is confusion about en- 
tropy being extensive, for many systems the total entropy 
is achieved by the multiplication of subsystems, but this 
is not always true. Hill [6] includes examples where multi- 
plication over subsystems does not yield the true entropy 
of the composite system. 

Most non-linear functions N(x, y) do not separate with 
a superposition principle, for example a separator function 
S does not exist such that 



S[N(x,y)]=A(x)+B(y). 



(9) 



The mathematical details for determining if the rule for 
combining systems can be deconstructed so that a valid 
separator function S exists are discussed by Tretiak and 
Eisenstein (lij . 

An informal argument is sufficient for our purposes to 
capture the flavor of the conditions for S to be a separator 
function. By taking the partial derivative (f tX = gj) of 
Eq. (9) with respect to each of the individual arguments, 
we have 

S'[N(x,y)]N x (x,y) = A x (x), (10) 



and 

S'[N(x,y)}N iy (x,y) = B tV (y); 
combining we find 



N, x (x,y) _ A jX (x) 
N y (x,y) ~ B <y {y)- 



(11) 



(12) 



Then, by defining 



H(x, y) = In 



we see that 



and 



N x (x,y) 

N y (x,y) 



H, x (x,y) 



lnA <x (x)-lnB !y (y), (13) 



~A x Jx)' 
B ,yy(y) . 

B, y (y) ' 



(14) 



(15) 



thus the first partials of H (x, y) are functions of a sin- 
gle variable and separation has been achieved. This pro- 
vides the means of finding a separator function for N(x, y). 
In thermodynamic language, the existence of a separator 
function means that there is a Maxwell relation between 
the variables A and B. 

Generalized superposition provides an interpretation of 
the extensivity property of entropy when it exists. In fact, 



generalized superposition can be used as a guiding princi- 
ple to look for extensive variables in a generalized setting 
[la . Il7 | of determining the thermodynamics of complex 
systems. More general types of entropy- like variables can 
be defined using this form of generalized superposition. 
Since the rule for combining subsystems into the whole 
is nonlinear, the principle of generalized superposition al- 
lows us to look for a rule that gives the appearance of lin- 
earity, and hence extensivity. Linearity on a macroscopic 
scale gives us a generalized thermodynamics of complex 
systems. The realization that the counting functions that 
enumerate the states have an underlying separator func- 
tion that obey this generalized form of superposition allows 
us to generalize the concept of extensivity. Thus, we define 
a system as obeying a principle of generalized extensivity 
if it obeys Eqs. (7) and (9) rather than Eqs. (1) and (2). 

2.2. Other Forms of Extensivity 

A second possibility that allows us to consider another 
type of extensivity is illustrated by considering a relax- 
ation of the linearity requirement. An enumeration func- 
tion need not be strictly linear either. An example of this 
is illustrated by attempting to linearize a counting func- 
tion such as the factorial n\. While ln(n!) is not linear, it is 
approximately linear for a physical system that has a large 
number of components; thus for all practical purposes 

ln((n + to)!) « n ln(ra) + m ln(m) ln(n!) + ln(TO,!); (16) 

so nl has been linearized with respect to the logarithm. 
We have omitted a factor 0(-)in Eq[T7JJ this term is ig- 
norable in systems that consist of a significant number of 
interacting units. The only time this factor plays a role 
is when trying to determine the transition point between 
collective and individual behavior, such as in the question 
of how many atoms are required before a system acts like 
a liquid or solid, or at the nanoscale where collective be- 
havior starts to break down. (We will discuss this question 
further in a subsequent paper - it is largely outside of the 
purview of this paper.) The difference between approxi- 
mately linear and linear is a point that is not emphasized 
as examining the factorial function illustrates. There are 
a number of different functions that are linear in the Stir- 
ling approximation. This notion of extensivity is captured 
by what we term Ulam extensivity that is related to the 
mathematical properties of functions that are termed ap- 
proximately linear [l8l - [20j ] . Consider 



f(x + y)-f(x)-f(y)*C + Oto(x)), 



(17) 



where g{x) tends to as a; becomes large, which is the 
reason the logarithm of a factorial gives the appearance of 
linearity for large n. Vogt [2l[ has discussed form isometry 
which could be considered as a means to generalize Ulam 
extensivity. 
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2.3. Power Laws, Homogeneity, and Extensivity 

Generalized extensivity connects power laws and homo- 
geneity together. To illustrate the concept of generalized 
extensivity we consider an example of a system that has a 
power-law like combination rule for counting combinations 
of states which is defined by 



x(n) = [xi{n)] a ■ [x 2 {n)Y 



(18) 



where a and /3 are constants constants. Notice that with 
the introduction of a separator function for multiplica- 
tion, the logarithm, we have 

log(x(n)) = log([x 1 (n)] a -[x 2 (n)f) (19) 
= a(log [<ci(n)])+i8(]og [x 2 {n)}) . 

Thus recovering a familiar superposition principle. If we 
then chose a = /3, we have 

log(ar(ra)) = a (log [xi(n)] + log [x 2 (n)]) . 

This equation reminds us of the basic definition of exten- 
sivity through the theory of homogeneous functions. We 
will now review the basic ideas through which we can an- 
alyze power laws using generalized extensivity. 

The functional equations appropriate to the study of 



homogenous functions were developed by Euler [22], |23 |. 
Davis [H, Stanley (H, and Widder 



provide mod- 
ern introductions of varying degrees of sophistication to 
functional equations. In general, a function f(x) is a ho- 
mogenous function, if for all values of the parameter A, 



f(Xx)=g(X)f(x) 



(20) 



Stanley [25j has shown that g is not arbitrary function, 
instead it is the parameter raised to a power of n. Thus a 
homogenous function fix ) is one that satisfies 



f(x\) = \ n f(x) 



(21) 



This definition can be extended to any finite number of 
variables. The degree, n, is restricted to integer values 
only. It is possible for multidimensional functions to be ho- 
mogenous of different degrees for different variables. This 
is common occurrence in thermodynamics. For a function 
in the variables x, y, and z; the function satisfies 



f{Xx,Xy,z) = X"f(x,y,z), 



(22) 



we say this function is homogenous of degree n in the vari- 
ables x and y which it is not homogenous in the variable 
z. A definition introduced by Stanley [25| of a generalized 
homogeneous function, is that it is a function that satisfies 
the equation 

f(X a x,X b y) = Xf(x,y). (23) 

It is this formulation of homogenous functions that is widely 
used in the analysis of critical point phenomena and phase 
transitions using the static scaling hypothesis. Functions 



that are homogenous obey the principle of generalized su- 
perposition since / (xX) — X n f(x) and / (yX) = X n f(y) 
so in general X n f(x) + X n f(y) ^ f (Xx + Xy), however for 
n = 1, we have 



Xf(x) + Xf(y) 



f (xX) + f (yX) 

f (Xx + Xy) = f (x + y) 



(24) 



so homogeneity and extensivity are the same for some 
types of functions. This form of extensivity is what we 
term homogenous extensivity. 

2.4- Symbolic Extensivity 

The concept of symbolic extensivity arises naturally 
from dimensional analysis. Three approaches can be taken 
based on the common aegis of dimensional analysis codi- 
fied by Bridgman [27| . You can take all the physical units 
that are required for a complete system specification of a 
physical group of functions such as length L, time T, mass 
M, etc.; so the dimensional symbols action under the 
operations of arithmetic constitute a mathematical group. 
For example, consider the symbol for length L. Combina- 
tions of L form a group Ql- there is an identity, L° = 1; 
there is an inverse, 1/L or L~ 1- , and L raised to any ratio- 
nal power p is a member of Ql which has an inverse L~ p . 
The group operation is multiplication, with the usual rules 
for handling exponents (L n x L m = L n+m ). For exam- 
ple in classical mechanics, any physical quantity can be 
expressed dimensionally in terms of base units which have 
dimensions M , L, and T. 

From this group specification, by noting that by re- 
placing a variable x in fix) by (x + 5 X ), it is natural to 
define f(x) to be translationally extensive if 



f(x + S x ) = f(x) + f(5 x ). 



(25) 



The degree of non- extensivity S (x, S x ) of a function f(x) 
is then 



f(x + 5 x )-f(x)-f(5 x ) 
/(*) 



E(x,5 x ); (26) 



so S (x, 5 X ) = for an extensive function. For a function 
that is Ulam extensive, 



H (x, S x 



C 



(27) 



which is effectively zero for almost all g(x), especially those 
that scale with the number of objects. As an example, 
the area of square of side x is x 2 , so f(x) = x 2 , then 
E(x,S x ) = ^r, so for 5 X « x, E(x,6 x ) ~ and area of 
square is approximately extensive; however, when x be- 
comes comparable in size to 5x the area is non-extensive. 
This behavior is potentially observable at the transition 
from macrosy stems to nanosystems. To extend the defini- 
tion to multiple dimensions, we define the degree of non- 
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extensivity as 

X\ i %2 H~ &X2 ) ***) ~t~ ^ n 



(28) 



A multidimensional function is translationally extensive if 
S f af, o ^ = 0. The volume of a cylinder is irlr 2 , so the 
degree of non-extensivity is 



E(r,5 r ,l,Si) = 



/(r + 3 r ,i + &)-/(r,Q-/((S,.,ft) 
/(r,0 



I 



h 



It is only when the fractional terms scale with the dimen- 
sional ratios, ^rand y, that the degree of non-extensivity 
is not effectively zero. For most volumes for which we have 
an analytical formula, they can be translationally exten- 
sive until the dimensional ratios, —and ^f, are of similar 

1 r I 1 

size, then extensivity breaks down in a non-linear fashion. 

The dimensional specification group, Qs, is constituted 
from the individual units of the dimensional quantities 
that constitute the units of the overall complex system 
which are labeled U\, Ui, U n in the system specification 
which are specified by the groups Gu ± , Gu 2 >-••> 0u n - The 
complex system group is obtained by taking the direct 
product, <g), of these groups : 



Qs = Qux ® Qu 2 



(29) 



It is possible to use the complex system group to formulate 
a dimensionless specification for each complex system units 
provided they are specified by scaling factors. Thus, for 
a complex physical system specified by variables x\, x%, 
— can be represented as P (xx, Xi, x n ). The way 
to remove the dimensions from a physical variable is to 
replace x\ — > 6 Xl %i where <5 Xl has units proportional A 
function that satisfies 

f(s xi xi) =g{e Xl )f{xx) 

which is scaling or homogenous extensivity. Necessarily, 
since 

lim / (e ai n) = / (a*) (30) 

which means lim ea . _>i g (e Xl ) = 1. So by an argument sim- 
ilar to the one used by Stanley in the previous section 
g ~ x n . So this type of extensivity reduces essentially to 
earlier work. 



3. Discussion and Conclusions 

The notion of extensivity extends beyond physics to 
the entire subject of complex systems [28| . While the sur- 
vey by Tsallis and Gell-Mann discusses many non-physics 



applications of Tsallis entropy [29J, we would argue that 
the same applies to generalized extensivity for much the 
same reasons. Furthermore, extensivity and its generaliza- 
tion applies to a new area of physics that is just starting to 
be explored: nanothermodynamics, a name that has been 
proposed by Hill (30l . l3~0 ] . Nanothermodynamics requires 
that chemical potential as well as variables that are exten- 
sive require a reformulation by scaling them, not relative 
to one scaling component JV, but rather rescaling the mul- 
tiple components relative to scales of different sizes Ni. 
The appearance of collective behavior, e.g. nanothermo- 
dynamics, emerges only if the collective components act 
together in a unified manner, a type of generalized exten- 
sivity 32(. 

In conclusion, we have proposed a means of extending 
the concept of extensivity to a wider variety of physical 
systems as well as to the wider subject area of complex 
systems. As a result of this, we have suggested that the 
Tsallis entropy could be interpreted as a form of general- 
ized superposition for some power laws. 
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